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ABSTRACT 

One of a series of instructional booklets designed to 
introduce adult education program planners to the basic concepts 
integral to and alternative Strategies for conducting needs 
assessments, this instructional booklet deals JUJtJLdetenn 
gather information for a needs assessment. Described first is the 
relationship of the process of determining how to gather information 
to the entire needs assessment process. Following an examination of 
some major collection strategies, guidelines are set forth for 
selecting those strategies that arefeasible and most able to provide 
valid and reliable information for ne^ds assessment. Also outlined 
are some retrieval strategies for extracting quality need data from 
relevant and available printed information. (MN) 




*********************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
*********************************************************************** 




co 




Special Community Service 
and Continuing Education 
Project. 



Final Report. 



DETERMINING 

WHAT 
INFORMATION 
.TO COLLECT 



V 



DETERMINING 

WHERE 
INFORMATION 
CAN BE FOUND 



DETERMINING 
HOW 
TO GATHER 
INFORMATION 



ERIC 



\ 



US DEPARTMENT OF EDUCATION 

NATIONAL INSTITUTE OF EDUCATION 

IDEATIONAL HtSOUHCFS INFORMATION 
J CtNT£H «E«iCi 

f T>v«. tUrtuftwM h,j<, <r>f>fc<JtiCt*rt .1$ 

'<'"'iv>(J ffom »*»•■ (*«'*v>n at of<).ini^ tinn 

<>fi<jtf »ttrnj if 

Wifn, rian< f i^ h«w»» r>*'<*fi nM<J»« ,o improve 
M'0f'v<J!l< t.on fju.tlify 

• F>o«>»* of /i«'vv at of whops <»Mir<J m »ht% rjocu 
riwot tjo mot M^o^vifily f«(>rj>$'-'ni official NIE 
portion of (K>l«:y 



DETER? 
HC 

TO SIM 
INFOFJ 


tENING 

4ARIZE 
4ATION 




f 


DETERMINING 
HOW 
TO INTERPRET 
INFORMATION 



DETERMINING 
HOW 

TO GATHER INFORMATION 



By 

Paulette T. Beatty 
Project Director 



In Collaboration With 

Michele Sabi.no 
Research Associate 
And 

Audrey Tsui-Chan 
Research Associate 



ERLC 



SE RIES PREFACE 



This instructional booklet is one of a series prepared by the 
Special Oannunity Service and Continuing Education staff at Texas MM 
University. Its purpose is to introduce a diverse body of adult educa- 
tion program planners to basic concepts integral to and alternative 
strategies appropriate for conducting needs assessments. A broad base 
of research and information relevant to practice has been tapped in 
the development of the series. 

This series is not in its final form but is rather "in develop- 
ment" as prepared for one-on-one testing in conjunction with a collection 
of adult education practitioners. Refinements are to be made subse- 
quent to one-on-one, small group and field testing. 

Recognition is given to those agencies and individuals who have 
contributed to the development of this series: 

U.S. Office of Education, Department of Health, Education and 
Welfare, for providing- funding; 

Participants in the pilot test activities for generating case 
study applications: Mr. David R. Chagoya, Mr. Robert Felder, 
Ms. Alice Franzke, Mr. Jan Johnson, Sr. Maria J. Leavy, Mr. Jose 
D. Leza, Lt. Col. James V. Mahoney, Jr., Mr. G. M. Milbum, Jr., 
Capt. William J. Schrank, Ms. Lois Soef je and Mr. Charles Weichert. 
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Members of the staff for continued investment in all dimensions 
of the project*: Dr. Paulette T. Beatty, Project Director; Mr. Bill 
Hale, Mrs. Michele Sabino, Mr. Walt Troutman and Mrs. Audrey Tsui- 
Chan, Research Associates ; and Mrs. Merle Rucker and Mrs. Brenda 
Snow, Secretaries. 

Project bcnsultants for willing collaboration in materials develop- 
ment and testing as well as external evaluation: Dr. Ernestine B. 
Boclair, Dr. Wayne L. Schroeder and Dr. Thanas J. Sork. 
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booklets in this series please contact: 

Dr. Paulette T. Beatty 
Mult and Extension Education 
College of Education 
Texas A&M University 
College Station, Texas 77843 



The work presented herein was performed pursuant to a grant frati 
the U.S. Office of Education/ Department of Health/ Education and 
Welfare (G007904214) . However/ the opinions expressed herein do not 
necessarily reflect the position or policy of the U.S. Office of Edu- 
cation and no official endorsement by the U.S. Office of Education 
should be inferred. 
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BOOKLET 3 

DETERMINING HOW TO GATHER INFOPMATICN 



Introduction 

Analogy 

This booklet should be no more foreign to you than your favorite 
pastime of extracting a secret and delectable recipe from its protec- 
tive inventor. This has got to be cne of the more fascinating games 
that people play. And if ever you have played it, you have learned — 
probably the hard way — that what you see or what ycu taste is highly 
dependent upon the whys and wherefores of seme very fancy maneuvers or 
strategies en your part. - ~ 

Well, let us suppose that your neighbor has beccme a legend in the 
irmediate vicinity for her silky cheesecake extxavaganza. For years you 
have been itching to have the recipe in your repertoire of foods for 
special occasions. That is what you have wanted all along, for a long 
time. You've often tried many tricks of your own to try and approxi- 
mate her recipe, bat to no avail. You and your neighbors have even 
caripared what you did Li arrivrig at your futile results. Now you have 
deci upon a more aggresive approach. You politely ask for the rec- 
ipe. What ycu get is, "I don't want to give it out because if you use 
it and do something wrong, you will pass the blame an to me, and that 
will be the end of my fame in the cheesecake circle 4 '. You next suggest 
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—after a respectable interlude — that she join you: as one of the chefs 
for the Elks annual fund-raising dinner. Together, ycu both can pre- 
pare a cheesecake dessert. What you get this time is, "It would be an 
offcJise against the palate to serve cheesecake as a dessert for a pan- 



her to enter the annual "dessert recipe of the year" contest which is 
being run by the city newspaper. What you get here is, "Those judges 
lack any sense of fine cuisine; they have grown up on nothing but bar- 
beque and beans. I have no interest in subjecting my 'prize' to the 
indignities of such cannon folk". At one point you seriously consider 
breaking and entering, but disniss this as too sloppy an approach. Fi- 
nally, you broach the subject again. The occasion is the first visits, 
in a three year period, of ycur mother- and father-in-law. You would 
like your neighbor to do her part in building family relationships by 
parting with her recipe. She grudgingly agrees. You make the cheese- 
cake, and it is a prize. At last, you finally struck the right chord and 
you were able to get the information you so desperately wanted. Count 
your blessings, you may not have been so fortunate. Sane of us have 
lived through friendships in which a special ingredient or procedure 
was emitted when the recipe was conveyed and all was not well. 

Strategies to gather information are much the same as strategies 
to extract recipes. Alternative approaches need to be considered so 
that what appears most likely to succeed will be chosen. It is a fine 
art and care must be taken to insure that: you get what you are after? 
nothing more and nothing less. 



cake and sausage roundup". 



Again, sane months have passed, you encourage 
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Purpose 

Having been introduced to techniques for identifying and locating 
the major sources of information for your needs assesanent, you will 
new be presented with procedures for gathering your needs- assessment 
information. The purpose of this booklet is to help you to develop and 
select strategies that are feasible for you in your particular situa- 
tion and that can provide ycu with valid and reliable information in 
the needs assesanent process. 

This booklet will consist of two major focuses. The first focus is 
detennining collection strategies. Here, we will suggest various meth- 
ods far obtaining need information fran your primary sources, namely, 
the authorities and target population you have identified for ycur needs 
assesanent. The second focus is the determination of retrieval strate- 
gies. Here, we will provide you with guidelines for extracting data 
fran the printed information which is relevant and available to ycu in 
your study. 
Linkage 

In the second booklet, Determining Where Information Can Be Found , 
you were introduced to the major sources of need information and sane 
approaches for locating these sources effectively. In this booklet, we 
will assist ycu to determine ways of approaching or interacting with, 
ycur sources of information — key informants and printed information — 
and thereby iinprove the probability that you will obtain the quality 
information you seek. Then, in the following booklet, Deternining Hew 
to Organize Information , we will nhow you ways of organizing your infor- 
mation once you have gathered it. 
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Rationale 

At no point in the needs assessment undertaking can one sit back, 
heave a sigh ' of relief and simply coast to the finish line. At each 
stage of the process, it is possible not only to make a tactical error 
and reduce the effectiveness of that particular part of the whole; tut, 
it is possible also to undo much of the groundwork which had been pre- 
viously laid. If ever this were true, it is true of the data gathering 
process. By the time you have reached this decision point of the needs 
assessnent process you have very deliberately determined the critical 
information which you are after. You have also determined the most 
appropriate sources to tap in securing this information. These new 
are givens in your needs assessment. Care must continue to be exer- 
cised in gathering your data. You will be wanting to reflect upon whe- 
ther method 1 or method 2 or method 3 is the best way to secure this 
particular bit of information frati this specific source. You knew your 
information and you know your sources, now you must pick the right piece 
of the jigsaw to make a perfect fit. Gathering information fran author- 
ities, target groups and printed information is a challenging under- 
taking. 

Quite different strategies are likely to be dictated for collecting 
information fran authority groups and for collecting information fran 
target populations. Not all collection strategies will fill the bill 
across the board. Very probably there is not one single strategy 
equally suitable nor feasible for getting information from various in- 
formant groups. Therefore, when obtaining need information fran dif- 
ferent sources, we might select different strategies in order to tap 
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information most effectively. 

When retrieving need data from printed information, it is critical 
that we select only information that is objective, rigorously collected, 
and in agreement with the purpose and coverage of the needs study. 
Practically, it would be of little value to us if we retrieve informa- 
tion that has been collected carelessly or with bias and may thus have 
questionable validity. Besides, if the information retrieved is not 
compatible with, our needs assessment in respect to its objectives and 
coverage, sane hard decisions are called for. 

Determining Collection Strategies 

Concept 

In this section we will discuss seme major collection strategies 
and guide you in the process of selecting those strategies that are 
feasible and are most able to provide you with valid and reliable in- 
formation for your needs assessment. 

A collection strategy is defined as a method whereby data relative 
to human needs are obtained fran authorities or target groups . A col- 
lection strategy is the method you use in approaching your key infor- 
mants in the needs assessment process. For instance, you may want to 
approach the authorities through group sessions and informal contacts, 
and you may also' choose to reach the target population of your needs 
study through sane form of survey and same selective personal obser- 
vations. Each of these approaches carries with it unique advantages 
as well as disadvantages* To make the best use of each approach, it is 
important for you to be able to recognize these. 

By way of a specific example, let us suppose that you have been 
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assigned full-time by the corporate training manager for 1 >jxas Instru- 
ments to do a "feasibility study" an the development of corporate post- 
retirement career preparation programs for pre-retirement employees and 
their spouses. You have been allocated six months for your study, have' 
been provided with an assistant, a secretary and a budget for non-per- 
sonnel expenditures of $20,000, Assorting that you have made careful 
determinations regarding the information with which you ought to for- 
tify yourself and the ideal key informants and printed information to 
consult, the following scenario is quite I \ely in terms of data col- 

0 

lection strategies. You make plans for an extended on-site visitation 
of the two model programs currently in the third year of operation 
within a sister industry in the country. You make plans for observing 
the operation and for meeting with the program leadership, current par- 
ticipants, "enlistees" and "graduates" of the program. You also make 
plans for open plant meetings for the employees of T. I. age forty and 
over and their spouses; as well as plans for a mailed survey of person- 
nel retired from T. I. within the past two years. Management will be 
polled via weekly in -house management memos to assess the level of sup- 
part for such a program. Lastly, members of the Governor's Council on 
Aging and its regional representative have agreed to** serve as a cannit- 
tee providing feedback as requested during the needs assessment process. 
Process 

To identify vaJ 4 d, reliable and feasible collection strategies from 
key informants for your needs assessment, we propose that you follow 
four steps. 

First, develop an extensive listing of possible strategies for 
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collecting data fron the key informants. % One type of strategy involves 
individuals remanding independently to your stimulus questions. Mailed 
questioonai re\ surveys , personal individual interviews, telephone studies, 
newspaper or othbr^W surveys are of this first type. A second type 
of strategy involved x tte collection of data frcm groups of people. 
Open forms, panel discussions , town meetings, information sharing 
groups, seminars, workshop^Xpsnferences or meetings vtith an advisory 
group are of this second type. >^In addition, don't forget that there 
are numerous ways of reaching the%uthorities or target population for 
your needs assessment informally. N\ 

Second, compare the relative advantages and disadvantages of each 

\ ^ 

strategy. Will the strategy provide valid apd reliable information? 

Let us look at another example. You, Associated-Director of the Valley 

\* 

Co-op f have just received funding fron the Texas Education Agency (TEA) , 
Division of Mult Programs , to conduct a pilot orogfan in nutrition 
education for migrant women in the Valley. You have decided a needs 
assessment is appropriate. You are anxious to learn hew th&se wcmen 
perceive their needs. You have decided on a mailed survey questionnaire. 
Hold everything! Mailed questionnaires have been employed very ei 
tively in the past in various settings to determine nutrional needs 
of women, so it is not an untried method of data collection. But, do 
migrant families have addresses that would make postal service deliv- 
ery likely? Are all migrant women literate in the language of the sur- 
vey? Are they apt to be skeptical of responding for fear of some pow- 
erful entrapment? Are they ashamed of their conditions and in need of 
anonymity? Are they apt to* be resentful of what they feel would be 
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an iinpositicn of anglo eating customs and norms?\Has "schooling" ever 
been a positive force in their lives? Vfould a mailed survey — assigning 
it was deliverable and could be read — be an appropriate data collection 
strategy given the major attitudinal barriers that are likely to exist? 

So, in general, it might be safe to say that a mailed questionnaire 
a survey allows wide coverage with minimum expense; affords ^wide 
geographical contact; reaches people who are difficult to locate ;\and 
gives the respondents time to respond, opportunity to consult witii 
someone else and a chance to respond independently. It is also pos- 
sible to say that in general the mailed questionnaire provides no guar- 
antee of response rate, provides no guarantee of the ability or will- 
ingness of the respondents to provide information and provides no guar- 
antee against the possibility of misunderstanding or misinterpreting 
the items in the questionnaire since there is no opportunity for prob- 
ing questions or observations on the part of an interviewer* 

Problems likewise can occur with telephone surveys, newspaper sur- 
veys, or even door to door interviews* Further, strategies that involve 
interpersonal group interaction like consensus meetings, town meetings 
and such are likewise rarely the perfect solution* 

Now, you might voider which single strategy or collection of stra- 
tegies would best serve your own needs assessment undertaking. Unfor- 
tunately, there are no universally accepted answers; but there are 
guidelines which you can follow; namely, review each strategy against 
the backdrop of what information you wish to collect and from wham ycu 
wish to collect it, then rigorously note the advantages and disadvan- 
, tages of each strategy. A caution i3 in order. It is helpful to 
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remember that, regardless of the approach which you choose, there will 
be limitations inherent in that approach and ycu must be aware of those 
limitations if you want the strategy to work to your advantage. 

In cur third step, we suggest that you assess the availability of 
himan skills, personnel, time, finances and physical resources either 
within your institution or which are otherwise at your disposal for 
the needs assessment undertaking. Identify those strategies which are 
feasible to employ in your needs assessment* 

Fourth, you should select those data collection strategies which 
provide you with the most valid and reliable information and which are 
at the. same time feasible for you. In other words, make sure the stra- 
'tegies you employ will give .you answers you are seeking and will elicit 
canparable responses ware you to question similar groups or the same 
group at different times* 

Thus, the principle for practice is that needs assessors should 
select Vctlld, reliable and feasible information collection strategies 
for authorities and target populations * 

Determining Retrieval Strategies 

Concept 

In the following section we will present sane retrieval strategies 
for extracting quality need data from relevant and available printed 
information. 

A retrieval strategy is defined as a method whereby valid and re- 
liable need data can be secured frcm available and relevant printed 
information * A retrieval strategy indicates the way that you actually 
pull the relevant data frcm seme available document or written record. 
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There are six factors that have been identified and are generally 
recognized which directly bear upon the quality of the data you retrieve 
fran available printed information. They are the factors of purpose, 
definition, geographical coverage, population, time frame and method- 
ology. All printed information which you are considering for use with- 
in ycxir needs assessment should be examined in light of these six fac- 
tors. For example, suppose that you are the Director of Patient Edu- 
cation at the state hospital in Rusk and you are going to study the 
"coping" needs of the short-term institutionalized adults in the insti- 
tution. 

Over tte two years of your working within the hospital you have 
becone increasingly convinced of a single and overriding patient need. 
It lies in the area of patients 1 growing perception of themselves as 
dependent members of the hospital oanmunity and a gradual diminishing 
of the vision of themselves as active, independent and oaitributing 
members of the cannunity from which they came to the institution. Ycxir 
concern is hew to assist each person to see himself or bar self as ef- 
fective and at peace in the larger society. You have access to the 
following printed information: current patient records of the hospital, " 
a 5 year old study conducted by the hospital at the time of its antic- 
ipated demise at the hands of the state legislature, a three year 
old state-wide study of the patient profile of the state institutions, and 
records on all adult students within the hospital in your educational 
office. 

In reviewing information frcm each of these sources, ask yourself 
why the data shown in the records were collected, if these records were 

ERJC . . 17 
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looking at coping needs the same way you are, what geographical area 
was covered, what population was studied, hew long ago was the data 
collected and what methods were used to collect the data. When ycu 
canpare the answers to these questions to the purpose of ycur needs 
assessnent, you should be able to determine whether or not the infor- 
mation shown on such a record is appropriate to your needs study: wheth- 
er it is completely compatible and can be taken as is, whether it is 
comparable but in need and capable of adaptation with some extrapola- 
tion, or whether a review has yielded incongruity with one or more of 
the factors and consequently must be discarded. RarembaTy if the print- 
ed information isn't right for your purposes, don't use it. 
Process 

We suggest a four step procedure in retrieving data frcm relevant 
and accessible printed information. 

First, we recenmend that you assess the printed information which 
you have found to be accessible and apparently relevant in terms of 
the six factors we mentioned before. That is, you are asked to appraise 
the printed information in terms of the objectivity of its purpose; the 
closeness of its operational definitions—measures — to those employed 
in your needs assessment; the coincidence of its geographical coverage 
to the service area addressed in your needs assessment; the matching 
of the respondents reported upon in the study of the printed infor- 
mation to the target papulation in your needs assessment; the amount of 
time which has elapsed between when data was collected and subsequently 
prepared for publication as printed information in addition to the time 
which will have elapsed between the initial data retrieval and yours; 



Booklet 3 oontd. 12 
and lastly, the rigor of the methodology employed in collecting data 
for the printed information. 

Perhaps you are the newly appointed Training Director for Texas 
Legal Assistance Society (HAS) , Inc. a private , nan-profit organiza- 
tion of 25 part-time lawyers , 3 full-time lawyers, 25 full time para- 
legal personnel and a limitless number of potential clients. 

Ycu have been provided with a "manual" . This served as a guide 
for all training undertaken by the previous training director. It 
details what each workshop in a three year cycle should address. 

Legal Assistance Society , Inc. has decided to conduct a short term 
legal education assistance program for the Cuban immigrants currently 
relocated in El Paso. Obviously, our new training director has access 
to key informants tut she also has a very critical document at her dis- 
posal. But, here again, she must consider the six questions before 
buying all or part of the document as a definitive statement for the 
direction of the short term training program. What about the suitabil- 
ity of the manual in term of its purpose, its content, its geographical 
coverage, the target grcup, the "age" of the information and the process 
of its development. 

New, within this brief illustration and lacking further elaboration, 
cne might reasonably assure that use of one of the "canned" client work- 
shops would leave something to be desired. It was developed as a train- 
ing response to the routine types of learning needs manifest among 
legal, paralegal and client groups associated with TEAS, Inc. Thus, 
its purpose and content are suspect at least as far as the intended 
group is concerned. In like manner its coverage of "Texas" law and 
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rights and responsibilities for the resident is far afield f ran a group 
of Spanish speaking iirmigrants only temporarily located in Texas and 
likely to be located elsewhere. Lastly, the method involved in the 
development of the manual might well be suspect as well as its "age" 
for oftentimes such products grow out of "success" events and are given 
a stature and a permanence not warrented by the facts or by the passage 
of time. 

Second, after having assessed the document or documents , select 
that printed information which is completely applicable to your needs 
study on all six factors. 

Third, extrapolations should be made for the data which are not 
ocmpletely congruent with your needs assessment. So, if, as the pres- 
ident of the Christian Churches United, your target population in the 
needs assessment is unmarried mothers ages sixteen to twenty-one in the 
Austin area, and if you happen to find several research studies done 
nationwide on unmarried mothers, you must be careful to retrieve only 
that data that has relevance to the geographical area and the popula- 
tion addressed in ycur particular needs assessment. And, to keep you 
honest as well as to enable repeated access to this or similar documents, 
we advise you to describe and justify any extrapolations made. When 
you are well aware of the limitations of your retrieved need data, then 
you will not tend to overgeneralize. 

Fourth, discard that printed information which is judged inappro- 
priate. 

Thus, the Principle for Practice is that needs assessors should 
select information retrieval strategies from printed information to 
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take into account the factors of 




, definition , geographical cov- 



erage, population, time frame and methodology » 

Summary 

We have presented to you in this booklet two major typ^ )f strate- 
gies by which you can feasibly gather information for your needs assess- 
ment undertaking. Collection strategies are approaches that you use 
to actually reach your key informants in the needs assessment for valid 
and reliable needs data. They should be feasible enough to be adopted 



by the sponsoring institution. 

Retrieval strategies are methods which are capable of eliciting 
quality needs data frcm the available printed sources. Each potential 
printed resource for the needs assessment undertaking should be appraised 
in terms of the applicability of its purpose, definition, geographical , 
coverage, population, time frame, and methodology to that of the needs 
assessment. The information appraised can then be either adopted, 
adapted or discarded. 
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